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RASTER IMAGE PATH ARCHITECTURE 

The present invention is directed to systems and methods for 
optimized image reproduction, and in particular to an improved raster image 
path architecture. 

5 Conventional monochrome raster image path architectures are 

known to capture pages as either device-dependent binary raster images or as 
device-independent grayscale raster images. For example, monochrome 
raster image path architectures can capture pages as either device-dependent 
binary raster images in the form of TIFF 6.0 CCITT Group IV files or as device- 

10 independent grayscale raster images in the form of a JPEG compressed 
format such as JFIF. Images are typically scanned as grayscale (multiple bits 
per pixel) raster images and immediately converted into device-dependent 
binary (one bit per pixel) raster images that are targeted for optimal output on 
a specific print engine. As the characteristics of different print engines vary, so 

15 too will each device-dependent binary raster image vary. Factors such as 
whether the target print engine writes white or black, has minimal permissible 
line width, offers different tone reproduction curves, has availability of 
particular halftone screens, and employs error diffusion to minimize moire, will 
affect the makeup of a particular raster image file destined for use in a 

20 particular print engine. 

In a process known as segmentation, typically performed after 
scanning, image data is analyzed and separated into different regions, each of 
which being rendered to binary so as to print optimally on the intended 
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("target") print engine. Using various lossless compression algorithms, the 
resulting image files can be relatively small. 

Although such device-dependent binary raster image files can be 
used for printing of rendered images having high image quality, with such 
5 image files being optimized for an targeted print engine, the rendering and 
printing of such device-dependent binary raster images on print engines other 
than the targeted print engine can result in significant image quality 
degradation. 

In contrast, preserving the raster images in a device-independent 

10 fashion as grayscale images can be useful. Device-independent grayscale 
raster images can be sent to one or more differing print engines in a printing 
system so as to be rendered and printed with minimal image quality 
degradation. However, such rendering can require a very significant amount of 
print controller processing. If this requirement is unmet, the performance of the 

15 printing system will suffer. 

Furthermore, the file size of a device-independent grayscale 
raster image can be exceedingly large and in order to compensate for such file 
size, a device-independent grayscale raster image is usually compressed. The 
typical compression algorithm applied to a device-independent grayscale 

20 raster image is lossy, and the image quality of the resulting compressed image 
file is thereby degraded. 

It has been proposed to use of mixed raster content (MRC) 
image files, or the image data format known as TIFF FX Profile M, which 
supports multiple planes of image data. 

25 Unfortunately, only the most recently designed high-end print 

controllers are able to efficiently process MRC image files. Hence, using such 
files requires the development of a raster image path architecture that 
effectively offers a solution to not only the requirement for rendering and 
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printing image files prepared for modern, high-and print controllers, but also 
files prepared for legacy printing systems. 

Accordingly, there remains in the art a need for a raster image 
path architecture that has the capacity for supporting the rendering and 
5 printing of a device-independent grayscale raster image, while also offering 
the capacity for supporting the rendering and printing of a device-dependent 
binary raster image. Such an architecture would therefore provide the 
advantages of printing a device-independent grayscale raster image while 
preserving the performance and image quality advantages of a conventional 
10 binary raster image path architecture. 

According to the present invention, an improved raster image 
path architecture may be implemented according to the present invention for 
improved rendering and outputting of an image file. The embodiments 
described herein refer to output of image files on an output device in the form 
15 of a print engine in a printing system, but the references to such print engine 
as output devices are exemplary and are not to be limiting. 

In a first aspect of the present invention, a raster image path 
architecture is provided for: 

(1) capturing a source image to provide a device- 
20 independent grayscale image data; 

(2) generating the associated segmentation information 
needed for optimal rendering of the image data as a binary image; 

(3) determining a target output device and using the 
segmentation information to convert the device-independent grayscale image 

25 to a binary raster image optimized for the targeted output device; and 

(4) submitting the device-dependent binary raster image 
to the targeted output device. 

In another aspect of the present invention, a MRC-based raster 
image path architecture is provided for generating and storing device- 
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independent N-plane MRC grayscale raster image data, which can be either 
sent unaltered to a modern monochrome print controller, or can be converted 
to an appropriately-optimized, binary, device-dependent raster image file 
useful for effective printing on legacy monochrome and color machines. The 
5 contemplated MRC-based image path architecture may operate according to 
the following: 

(1) capturing a source image to provide a device- 
independent grayscale image data; 

(2) generating the associated segmentation information 
10 needed for optimal rendering of the image data as a binary image; 

(3) applying the associated segmentation information to 
create a device-independent N-plane MRC image file, having lower level 
planes for supporting a binary image representing any black text and line art, 
and having overlay planes for supporting grayscale overlays; 

15 (4) storing the device-independent N-plane MRC raster 

image file; 

(5) determining a target print engine having a print 
controller and determining whether the print controller can effectively process 
the N-plane MRC image; 
20 (6) if the print controller is determined to be capable of 

effectively processing the N-plane MRC image, then the N-plane MRC image 
is submitted to the print controller; 

(7) if the print controller is determined not to be capable 
of effectively processing the N-plane MRC image, the grayscale overlay 
25 planes are appropriately rendered and the image layers are flattened, thus 
yielding a single device-dependent binary raster image file that is optimized for 
the targeted print engine, which then is submitted to the targeted printer. 

In another aspect of the present invention, the conversion from a 
device-independent grayscale format to a device-dependent binary format can 
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be deferred until such time as the actual targeted output device, such as a 
specific print engine, is known. At such time of conversion, the information 
needed to perform the optimal conversion will be available, and the resulting 
device-dependent binary image will therefore offer a high level of image quality 
5 when outputted by the targeted output device. Furthermore, the print controller 
will be processing a binary raster image, and will be as efficient as if the 
conversion from grayscale to binary formats had been performed at the time of 
scanning. 

In another aspect of the present invention, the proposed raster 
10 image path architecture enables a novel flexibility for retargeting an image file 
stored in a device-independent format (which incorporates both grayscale 
image and preserved image segmentation data), yet nonetheless offers the 
image quality and productivity afforded by the conventional device-dependent 
binary image format. 

15 In another aspect of the present invention, the contemplated 

raster image path architecture uses the MRC format to support a structured 
grayscale image based upon segmentation data, while preserving the image 
quality and productivity of the conventional device-dependent binary image 
model on legacy monochrome and color printers. 

20 In another aspect of the present invention, the contemplated 

raster image path architecture captures images by creating and storing device- 
independent grayscale raster images together with the segmentation 
information needed for their later conversion to device-dependent binary raster 
images that are optimized for specific printers. 

25 In another aspect of the present invention, the segmentation 

information may be computed at an intermediate platform to convert re- 
targetable device-independent grayscale raster images to targeted device- 
dependent binary raster images 
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In another aspect of the present invention, the conversion of the 
device-independent grayscale raster images and their associated 
segmentation information to targeted device-dependent binary raster images 
may be reserved for implementation by an intermediate compute platform after 
5 the targeted print engine has been selected. 

In another aspect of the present invention, image data formed by 
creating and storing device-independent N-plane MRC grayscale raster 
images can preserve key segmentation information. 

In another aspect of the present invention, an intermediate 
10 compute platform may be used to determine the segmentation information 
inherent in the device-independent N-plane MRC grayscale raster images for 
converting these re-targetable images into targeted device-dependent binary 
raster images 

In another aspect of the present invention, conversion of the 
15 device-independent grayscale raster images and their associated 

segmentation information to targeted device-dependent binary raster images 

may be performed by an intermediate compute platform when a selected 

targeted is unable to process (or unable to process efficiently) N-plane MRC 

grayscale raster images. 
20 For a general understanding of the present invention, reference 

is made to the drawings. In the drawings, like reference numerals have been 

used throughout to designate identical elements. 

Figures 1 and 2 illustrate a first preferred embodiment of a raster 

image path architecture implemented according to the present invention. 
25 Figures 3A - 3D illustrate a variety of ways that may be 

employed for storage of the image data and tag information generated in the 

raster image path architecture of the present invention. 
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Figures 4-6 illustrate respective additional embodiments of the 
raster image path architecture that may be implemented to create and store 
device-independent N-plane MRC grayscale raster images. 

The invention is described herein with reference to one or more 
5 embodiments. However, it will be understood that there is no intent to limit the 
invention to the embodiment(s) described. On the contrary, the intent is to 
cover all alternatives, modifications, and equivalents as may be included within 
the spirit and scope of the invention as defined by the appended claims. 

The raster image path architecture implemented according to the 
10 present invention allows users to create and store device-independent 
grayscale raster image files (thereby providing image file portability) which, 
before printing, are optimally rendered as device-dependent binary raster 
images, thereby providing high performance printing of images having high 
image quality. 

15 A notable feature in the contemplated raster image path 

architecture is that segmentation information is generated and stored during 
image capture, but such segmentation information is retained until the targeted 
print engine is known, whereupon the segmentation information is utilized to 
render the raster image for printing on the targeted print engine. 

20 With reference now to Figures 1 and 2, an embodiment of a 

raster image path architecture may be understood to be implemented 
generally according to the following method steps: 

In step 11, documents are scanned to produce device- 
independent grayscale raster images. The resulting grayscale raster images 

25 are analyzed and segmentation information is generated. However, instead of 
being immediately applied to produce a device-dependent binary raster image 
a specific print engine, the segmentation information is preserved as tags 
which accompany the grayscale raster image data. 
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In step 12, the device-independent grayscale image data is compressed with a 
lossy compression so as to be visually lossless when the image is 
decompressed. The tags are compressed in step 14 using a lossless 
compression algorithm. The results of the processing in steps 12 and 14 are 
5 provided in step 15 to the workstation and optionally to a suitable storage 
device in step 16 for storage until the respective image is to be printed. 

When the user chooses to print the document, a printer (having a 
specific print engine) is selected. The device-independent grayscale image 
data and its associated segmentation tag information are retrieved from 

10 storage in step 21 and provided to a client workstation. Using the 
segmentation information generated by step 12, the grayscale image data is 
processed in step 23 as if it were being rendered by a scanner generating 
device-dependent binary images. Thus, each device-independent grayscale 
image is converted in steps 22 and 23 to a binary raster image that is 

15 optimized for the selected (targeted) print engine. 

The resulting device-dependent binary raster image data is then 
available to be submitted in step 24A or step 24B to its targeted print engine, 
either embedded within a PostScript submission file or as a separate image 
file referenced from a PostScript file. The respective print controller for the 

20 selected print engine can process the device-dependent binary raster image 
with high performance. 

Because the conversion from device-independent grayscale to 
device-dependent binary is deferred until such time as the targeted print 
engine is known, and because the most relevant information needed to 

25 optimally perform the conversion will then be available, the resulting device- 
dependent binary image will support high levels of image quality. For example, 
the same firmware rendering application-specific integrated circuits (ASICs) 
may be employed in the workstation as would be employed in a typical 
scanner, overall image processing performance will not suffer. Further, 
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because the print controller will process a binary raster image, the rendering 
and raster image processing will be as efficient as if the conversion from 
grayscale to binary had been performed at the time of scanning a source 
document. 

5 Certain variations in the illustrated implementation are possible. 

For example, instead of capturing RGB, as shown in Fig 1, only the green 
channel could be used directly to generate 8 bit grayscale images While this 
could reduce the bandwidth between the scanner and the image processing, 
the downside would be the loss of certain features such as conversion of color 

10 to patterns that preserve much of the color information even when printed on a 
black-only printer. 

Also, instead of converting the portable device-independent 
grayscale image to a device-dependent binary image by means of hardware in 
the scanner, this conversion could be performed either on the client 

15 workstation in software or in firmware executing on a more general purpose 
hardware accelerator. An additional cost-saving alternative for the conversion 
might be the implementation of looping the device-independent raster image 
files back to the rendering ASICs in a scanner. 

With reference now to Figures 3A - 3D, there is illustrated a 

20 variety of image planes arrangements that may be employed for storage of the 
image data and tag information. (Note that the segmentation tags generated in 
step 12 can be saved without any additional processing, or be converted into a 
more general type of information called hints.) As shown in Figure 3A, for 
example, a device-dependent data file may be supported in a single strip of 

25 binary image data; or as shown in Figure 3B, as a device-independent file in a 
single-strip, single JPEG compressed grayscale image plane plus a hint plane, 
file consisting of a single strip of JPEG compressed image data together with 
an additional plane of hint information, with the hints being used to store the 
segmentation information generated by the scanner. As shown in Figure 3C, a 
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device-independent data file is shown in a multiple strip, compressed 
grayscale image plane plus a hint plane. As illustrated in Figure 3D, a device- 
independent data file is shown in at least two image planes with a selector 
plane and a hint plane. Figures 3C-3D represent how the planes of device 
5 independent data and the associated rendering hints may be stored for a 
variety of reasons such as rendering productivity. 

As illustrated in Figures 4-6, embodiments of the contemplated 
raster image path architecture may be implemented to create and store 
device-independent N-plane MRC grayscale raster images, which, before 
10 printing, can be optimally rendered as device-dependent binary raster images, 
thereby resolving image portability and image quality problems, and the 
performance concerns inherent in use of legacy printing systems. 

After image capture is performed, segmentation information may 
be generated and used to create a high quality representation of black and 
15 white text stored in the lowest foreground, background, and selector planes 
and N-planes of grayscale objects represented as additional levels of 
foreground and selector planes. Because the MRC image selector planes 
preferably use lossless binary compression, they can preserve the sharp 
edges of text and line art in the captured image, thereby improving image 
20 quality. Also, by segregating the grayscale objects into multiple planes, image 
segmentation information will be preserved. 

The contemplated MRC-based raster image path architecture 
may be implemented as follows: 

As illustrated in Figure 4, documents are first scanned to 
25 produce in step 41 one or more device-independent grayscale raster images. 
The process may involve either use of a clear filter and the scanner's green 
channel or use of a three-channel RGB color image which is then converted to 
L*. In either case, a multiple bit per pixel grayscale image is delivered in step 
42 to an image processing module so as to be analyzed and for segmentation 
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information to be generated. The segmentation information is used to create 
an N-plane multiple plane MRC image provided to the workstation in step 43. 
The lowest level foreground, background, and selector planes are used to 
store a high quality representation of any black or white text in the image. 
5 Additional levels of foreground and selector planes are used to segregate 
different grayscale objects into their own layers. As a alternative option, the 
segmentation information also can be used for additional purposes, e.g., to 
suppress background, or to perform a descreen procedure. Such 
improvements to the background and the results of descreening will allow the 

10 file to be compressed to a smaller file size. 

As illustrated in Figure 5, segmentation and file generation can 
occur according to steps 51, 52 in the scanner (in which case the scanner 
sends N-plane MRC images to the client workstation in step 53) or in the client 
workstation (in which case the scanner sends the uncompressed grayscale 

15 image in step 53 to the client workstation, where it is segmented and an N- 
plane MRC image is generated). In the latter case, as another possible 
alternative, in lieu of sending a grayscale image to the client workstation, the 
scanner may transmit a full contone image, with the client workstation itself 
generating the grayscale image, i.e., converting the scanned RGB image to an 

20 L grayscale image. 

The device-independent N-plane MRC grayscale images are 
stored in steps 44, 54 in a file storage device until needed for printing. As 
illustrated in Figure 6, when an image is chosen for printing, a printer having a 
specific print engine is selected. It is also determined whether the printer's 

25 controller is able to process the N-plane MRC images efficiently. 

For those certain print controllers that cannot efficiently process 
a device-independent N-plane MRC grayscale image, the client workstation 
will deliver in step 61 (before print submission) the N-plane MRC grayscale 
image to an image processing module for converting the stored images into 
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appropriately targeted device-dependent binary images which are returned to 
the client workstation in step 62 and for storage in step 63 to file storage. 
Since the N-plane MRC raster image structure preserves the segmentation 
information, it then can be used to generate a binary raster image that is 
5 optimized for the selected print engine. Because the N-plane MRC images use 
window-based segmentation, they can be rapidly rendered into binary and the 
N-planes can be flattened into a single raster image. When the resulting 
device-dependent binary images are submitted to the print controller for the 
targeted print engine, (embedded, for example, within a PostScript submission 

10 file, or presented as a separate image file referenced from a PostScript file) 
they will be rapidly subjected to raster image processing and then are printed 
on the respective one of the legacy monochrome print engine, legacy color 
print engine, or future (i.e. modern or beyond) print engine. 

When submitting device-independent N-plane MRC grayscale 

15 images to a modern, high-end print controller that offers the special support 
used for effectively processing such a format, the client workstation need not 
first convert the images to device-dependent binary images. Hence, in this 
case, without additional workstation processing, device-independent N-plane 
MRC grayscale images will be submitted to the targeted printer's controller, 

20 either embedded within, for example, a PostScript submission file or as 
separate image files referenced from a PostScript file. In either case, the print 
controller then will efficiently raster image process the device-independent N- 
plane MRC grayscale image for the target printer. The processing can be done 
in software in the main processor of the printer controller or by the use of 

25 accelerator cards designed to handle N-plane MRC grayscale images and the 
associated hints/segmentation tags. 

For modern printing systems having, MRC-capable print 
controllers, the use of N-plane MRC grayscale raster image files will offer 
improvements in image file portability, image quality, and print system 
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performance. For all other printing systems, because the conversion from 
device-independent grayscale to device-dependent binary will be deferred until 
such time as the actual targeted print engine is known and because the 
information needed for optimal conversion will then be readily available, the 
5 resulting device-dependent binary image will support a high level of image 
quality. Also, because the print controller will be processing a binary raster 
image, the rendering and raster image processing will be as efficient as if the 
conversion from grayscale to binary had been performed at scan time. 

The contemplated image path architecture does not require that 
10 hint data be provided with the stored N-plane MRC grayscale raster image 
data. If the scanner is used to generate such data, the hint data can be used 
to significantly improve image quality. However, the availability of hint data is a 
complementary but not an essential part of the contemplated architecture. 
Additionally, in a printer controller with sufficient processing capability 
15 (provided, for example, by a high performance main processor, or by use of an 
accelerator card), the segmentation data can be generated in the print 
controller immediately preceding printing. 

Optionally, when taking advantage of high-performance print 
controller, the N-plane MRC grayscale raster image can be organized into 
20 multiple strips of image and optional hint data. 

As a further optional optimization step, the generated device- 
dependent binary images may be cached for later reuse. 

The examples described herein of the specific file formats used 
to represent the device-independent N-plane MRC grayscale raster image 
25 data are not intended to be limiting; for example, a variety of file formats such 
as TIFF FX Profile M, the JPM format of JPEG 2000, or PDF might be used. 

Furthermore, while the contemplated raster image path 
architecture has been described with reference to a monochrome path, the 
teachings herein are readily and advantageously extendable to an improved 
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raster image path architecture operable for color as well as simple grayscale 
scanned images. 

Accordingly, as will be appreciated by those skilled in the art, 
because the scanner and workstation generate the device-independent 
grayscale raster images and subsequently the workstation converts them to 
device-dependent binary raster images, the contemplated image path 
architecture is useful for use with both legacy and modern print engines. 
Further, the ability of a selected printer to process device-dependent binary 
images becomes an issue that is effectively independent of whether those 
images are generated during capture by a scanner, or later, at the time of 
printing by the workstation. 
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